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ABSTRACT 

This paper discusses the characteristics and 
operation of an evaluation process - transactional evaluation. 
Concentrating on the effects change has on those effecting the 
change, transactional evaluation stresses incorporation of both 
protagonists and antagonists into a change-oriented team. A copy of 
an evaluation questionnaire is included. (DIG) 
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CHAPTER I 

Introduction: What is Transactional Evaluation? 
.Robert Rippey 



U.S. DEPARTMENTOF HEALTH. 

EDUCATION & WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVE?* FROM 
THE PERSON OR ORG ANIZA1 :OI L RIG 
INATING IT. POINTS OF VIEW OK 
IONS STATED DO NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY. 



Transactional evaluation is a developing aspect of educational accountability 
which does not focus exclusively on the outcomes of changed programs in schools 
and other institutions as they affect a target population. Instead, trans- 
actional evaluation looks at the effects of changed programs on the changers 
themselves - on the incumbents of the roles in the system undergoing the change. 

As an example, if a school system was planning the introduction of a performance 
contracting system, transactional evaluation would not look at improved reading 
scores of students, but would look at changed role rel at ionsh i ps and latent 
apprehens fons among those responsible for the delivery of the educational services 
teachers, administrators, and perhaps parents. A comparison with traditional 
summative and foramtive evaluations would show that 1) The target of evaluation 
was different*: The subject of the evaluation would be the system, not the client 



of the services rendered by the system. 2) The variables would relate to the 

social, psychological, and communications aspects of the system, -t*©* the manifest 

A 

objectives. 3) The information would be continuously fed back into the system. 



*0 The evaluator himself would be more a part of the operating system. 5) Con- 
ventional cons iderat ions of reliability, validity and object ivity would be less 
important than timeliness, relevance, and observable effects of the generation of 
eval uat Ion informat Ion. The aims of the evaluation would not be primarily 
production of n^w knowledge, and the attribution of causality; but the transformat ioi 
of the conflict energy associated with change into productive activity, and the 
clarification of the roles of all persons involved in changes in program. 

It is a well known fact that changes often involve threats to the roles of 
incumbents in an organization. Changing programs require new skills and new 
behaviors. Persons holding positions feel that a considerable investment on their 
parts may be threatened by planned change. Therefore, conflict, foot dragging, 



and subversion can often be expected. In schools, this reaction to change 
ranges from small talk ?n the teacher's lounge to active subversion in a com- 
munity, or among a faculty. Although this resistance can be anticipated as a 
universal consequence of change, there are several optional responses open to 
the educator. One common yet deficient strategy of change suggests the following 
steps: 

1. Develop a single, plan carefully, and document the likelihood of its 
success. Restrict change to non-cont rovers i a 1 steps which will not 
disturb anyone. 

2. Obtain legitimation from external agencies, and published reports 
of success . 

3. Obtain further backing from a local teacher's commi ttee whi ch 
recommends universal adoption. 

4. Have arguments defending against all possible sources of criticism. 

5. ‘Introduce the plan to the entire system. 

6. Either do not evaluate the program, or try to show its success. 

7. ' Obtain publicity value from the program, but do not question too 

carefully whether the program is being carried out. Let teachers 
modify theprogram to suit their comfort and to reduce phone calls 
from parents . 

This picture of inconsequential changes, highly publicized, carelessly im- 
plemented, and unevaluated is not entirely foreign to education. 

On the other hand, another model is suggested by transactional evaluation. 

The first step would be similar to the first step in the traditional model: to 

carefully study a problem and to document the likelihood of success. However, 
several optional solutions might be entertained from the very start. As a second 
step, however, legitimation from external agencies, though useful, might not be 
so important. The third step would be quite different in that the change would 



not be recommended on a universal basis, but only to those who were really en- 
thusiastic about it. The program would begin on a small scale using its most 

enthusiastic and energet i c supporters . 

However, it is at this point that conflict begins, for if a successful new 
program receives praise or rewards, this will constitute a threat to those not 
originally involved. It is at this point where transactional evaluation becomes 
a useful tool in the change process. 

Transactional evaluation has two main phases. The first is the phase of 
uncovering sources of conflict through the use of transactional instruments, 
us'ng items developed by all persons involved in the change. 

EVALUATION QUESTIONNAIRE 
SEPTEMBER, 1971 



1. We need more courses directed towards the understanding A a 

of the inner-city child. 10 7 

2. My experience with the staff and Principal of school leave A a 

something to be desired. Too many inconsistencies with re- 2 6 

gards to rules, what was accepted as proper procedure for 
discussing problems. 



3. I enjoy classes though I find the 10 weeks too short a time A a 

to fully understand each subject 75 

4. Lack of experience in bi-li'ngual education, plus some lack A a 

of concern in a fellow team-mate, hinders the development 2 7 

of a "together" program at our particular school. 

5. The program as a whole suffers from domination from admin- . A a 

instration, rather than support and control from the commun- 9 2 

ities in which we teach. " 

6. We need more time to share teaching ideas and experiences A a 

with fellow interns. We could learn a great deal from 11 7 



one another, but there is no time provided for such exchange. 
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7. My experience so far has been extremely fruitful. 
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8 . In the community, the experiences have also been help- 
ful and rewarding. 

9 . Experiences with the administration have been exciting 
but not always rewarding. 

Such an instrument may contain items from a single group as in the example, 
or it may contain items submitted by several groups such as parents, students, 
or teachers. Once the instrument responses have uncovered areas of substantial 
apprehension, the second phase of transactional evaluation can begin. This 
phase Involves utilizing the proponents as well as the opponents of particular 
aspects of the program design in the development and implementation of an 1 

'I 

evaluation plan in cooperation with technical assistance from professional j 

4 

evaluators. - j 

’ * -'i 

The incorporation of both protagonists and antagonists into project monitoring j 

teams has several salubrious effects. First of all, the monitoring can include j 

i 

not only outcomes anticipated by proponents, but also unexpected outcomes suggestedj 

1 

by the opponents. Secondly, role apprehensions of non-believers can be alleviated j 

j 

by direct action of the project, in-service training, where necessary, and clar- 1 

| 

ification of policy. Obviously not all role apprehensions can be solved in this j 
v:ay, but many can be. A third beneficial effect of such a monitoring system is I 
that initial opponents to a program of change are given a legitimate constructive | 
role in the program. It is this legitimate role given to early disputants that | 

can lead to their incorporation and conversion. An opponent to a change may have J 
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a very legitimate objection. The change may really need modification. Initial 
opponents, given a legitimate, albeit sceptical role, may in fact, at times, 
provide just the skills or ideas necessary to keep a project off the rocks, or 
out of the slough of despond. 

It is perhaps at the point when a program of change receives its first 
criticism that one can tell whether or not transact ional evaluation is being 
used. If the response to that criticism is an answer, an explanation, or a 
defense, regardless of whether the defense is based on data, opinion, or the 
scriptures, then the answer is no. Transact ional evaluation is not spoken here. 
If on the other hand, the response to the first criticism is another question, 
exploration of both substance and apprehension, and the appointment of the 
doubting Thomas to a monitoring committee, then we can assume that transactional 
evaluation is on the agenda.. When a program of change looks beyond immediate 
outcomes of its manifest goals, and begins examining it roles, and the apprehen- 
sions of all parties to the system (including the client), when a program attempt* 
continuously to monitor its total effects, and respond to clarifying information, 
then it is participating in transact ional evaluation. 
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yransact i ona 1 evaluation may be a necessary part of effective 
change. The agr icul t.ural , medical, and dissemination models of change have not 
been particulary successful when applied to schools. As House states in his 
evaluation cf Illinois Demonstration Centers: 

If Havelock is correct, Research and Development models 
of change assume a passive user population which is shaped by 
the dissemination process itself. The facts; belie this assump- 
tion. Of far greater importance are the variables controlling 
the would-be adopters everyday world in his home district. The 
individual is caught in a powerful social web that determines 
• his behavior more than do his individual impressions gleaned 
at a demonstration visit. The variables that influence whether 
findings in this study are consistent with the "social interaction" 
change model which sees change as a result of the social relations 
network within the adopting unit. 

Unfortunately, examples of transactional evaluation are not readily 
available. The methodology has not been perfected. Applications are few 
and far between. The kind of data collected may not be clean enough to 
appear in more formalistic journals. Persons engaged in transactional 
evaluation may not realize the importance of what they are doing, and there- 
for may not motivated to publish. 



It is fairly untraveled ground, and subject to 
criticism from the research purist, on the right and the threatened ideologist on 
the left. It is a road not often taken, yet if we have educational promises to 
keep, we should perhaps travel at least a few miles down this road before we 
sleep. 
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